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ABSTRACT : PROBLEM TO BE SOLVED: To automate the processing of panorama composition for a 
plurality of images picked up by an electronic camera by means of a computer. 

SOLUTION: An electronic camera 307 gives a reduced 1st confirmation image in 
response to a request from a computer to the computer and the image is displayed on a 
display device 302. Then the position of the camera is moved and picks up an object so 
that part of a 2nd image is overlapped with the 1st image and the 2nd confirmation image 
is displayed. The user can make an overlapped state of the two confirmation images 
proper. Based on the relative position obtained by the confirmation images, the two 
images are connected to generate one panorama composite image. 
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&mmi>m<xmt*frt>xfoh« 

[0039] (HI 0tcS2<!0«ggB«c0S*i:>'^y7"7 

SrfHyn-^— Xf7728 0 1tK 

tT. &2aftBBtt£01W (x, y ) ^itt^^LT 
fi^T^K^-l). Xf 77280 2t, Zco^mM, 
(x, y ) «^^y^^S«f: LT^$*>L^tta36»if-5 

tt, fiat^SM»ai(:^^-A-7 77iii:ffi 

7 7 4 tl»»%V^) t v^*frT¥fBBft- 6. 

*^*fi^ffi-e«4 . mmcomm& « <rm& 1 5 % ± 5 % 

tiSrHI 1 1 tcH^rr& <> 2 9 0 1 SrSS 1 ^WSB«i:'t 
#«<7>ja*«l 5%±5%WrthV^^ 29 

o 2X9jk-tm2commmmtf2 9 0 3T^-r®sirt^iR 

Xf772803n°7tV^fL Xf 772804 
XS 1 C05IISB® h SI 2 <9ffi!gB«c9# S: ?B & t ^feT'^ 

[0040] <MC. Xf772805T\ it^^y^^ 
^fig^-C S =5: V ^ffiat* -o TUI»^aWfx7;!: 

tfc«^T*&. ft*WWi««ir%fe*»«?Difl^l 0% 
5fei^-A-9 77ik=SrotLio^fcS (t%* 
^. ^(c^lixT L£ ^tzm-^h^h ) iz, y\v^v 
-&fiE«*-C£ =SrV^fc ^JSFf "T 4 . <D 4: # (4^^ v 7° 2 8 0 

6x\ witft-vtv^fcasff^aj-t*. fif«>3&*co 




[004 1] &±T\ S2«*«L 

05«oa»^y2 3O4S:fP'rii:T\ S£2fl) 

mmmm^WLT^ts. *Lx&ftL#?y23 0 5tm- 
[004 2] &^m6oxf*^r2 4 i 5 5 

vB«^JSiffiSl;:ovvciai 2<?)yx=i-^^-btmz 
X 0B»8:#«* BMW'S. ^fXf771 3 0 1 T\ 

iEWfr-— SC^"* «t -3 l-Xx 7T1 303 ^ttJ&SSrMjai 
fcfcfcB«*-&JS-*S. 

[0043] ^t:±MXf771 30 1. 1 303, 
1 30 5, 1 3 0 6<7>i¥ffl£!ttHJl^&. ftlO^fyr 
1 3 0 1 

atwtz. mi 3tc^o-f-^-h^^. 5WaR*>fc 

ffiSft <x, y) ii, ig|gli«fci3tt&ffiS^ffl*t{a5 
^<:txf7r3 0 0 it C7/pb«£> 

I), f LTXf7/3002t(x > y ) fcCcOifc*:* 
a <! 4: t7/^^f XB«"COffi*ttiB ( X , 

Y) 

[0044] zcom&x-jRtbbtitim i commztt-th 
^2^B«coffi^res ^ v/ei) ( x . 
y) a, nBa«*offi«-c^ffl»taai (x. y> sras* 

#LT^6«rf8ttfc*&. L£>L(x, y)Tii;. ^co 
a (^--A-7 7rfil) (x, y) ii, ts^tz\^co\ti 

[ 0 0 4 5 ] [1 1 4 t:TOiai«I07Q-f^- h 
SSL, Hi 5fc:-£;fi£HSLfciO&^-. 01 5 
14, aEfc*«0iS«2tt^WSrS1'. B«<?>8dR#2tfcJ: 

0 ^ k # tt 2 f£c7>£j££ M®M& 0 iHtlf J: v ^"C 
JftHi: LT«a*WtCRIt"Cft6. 2005. 2006 




^68^9-3 2 20 6 0 

o 0 5 & x v v*«0r3e«ei±aa v^ssl, 

LTSsL fnIf^Sry7V-Mffii: LT 
WOftiK iiiJfyri/-Mft2 0.0 3ktSo 

[0 04 6] — =&Bfl^»JET6xyr2 0 0 6 + 
teli. T-^rix- hB«2 0 0 3 twStjCi-sa^^PS 
C:n&4»'C^cWSSJ£VfcKHSr1f—^KH2 0 
0 4h*T^o T"Vru-bB«2 0 0 3Sif-f"KH2 
0 0 4±(c»^TB»*{tT*Ol6»*k*. 
36«S/hfc=5rS k £ *>£lf-*eH±S: 1 B*-$*-^6 L 
T#tf> S • -9--f*§Effl_h££T^-^ LjfcttSKoft'hffi 

BfffitfjaT-cftft.tr. *<osK>f yhm± <x, y > 

k (x' , y' ) SrSt«jft<?y<rkLT«l*-*-*. 

[0047] a±.fimmcommt%:&tf, zitzmi 4 

771 9 0 lT , x./^i*aiB«S:f^fiS:-r&. fLTXf 
7/1 9 0 2T\ Clc^x-y^ttaJB^+^^vrU— 
h&»5£-$-£ffl£H2 0 0 5^^X7^EFffiffiia_h3fi^ 
^yh^ito -etT^iM y hT^ftntf. ^f7 

7190 3T^-OtK^ y h^^$Sg|±nBlg-roc0^ 

TBms-ra i 9ttiL^yrL'-h®mk*r§o awrv 

T1 9 0 4T. Zcotf^yv&itiMfrh. tBft+wr 
^H6B£K5&*-6. ^LTXf77°1 905T\ t- 
^IEH+^H«kf-yr^-hB«S:Sfa-&*)-fr. BiS 
4MST\ ®Sffi^l^*&#ffi£k 9*^£#f-£*tf>&. 
mz*7~ v r 1 9 0 6 T<r ^Mfl^fHia 5 . x*co 
m^m^d^tr^x -J? L, fit*fLtf^f7ri 
9 0 7T*cO^-fHEIffl+<95JM V hO^flk . ^COS 

[0 0 4 8] W-t^-t-^iEH^TCC^^^. ^bT 
At v 71 9 0 8 W-f Eitt Cov^JffiiLfc** 
Sfx7^L, Xf7 7°l 9 0 9T'*^*S**^)feft.st 

WfittLkJtKLTWEBrt*. »fte«LJ: »)/h3*»ofc 
^f771 9 1 0T\ M^'JxbCf^' 
V-hB»S:fl)0aiL3t^ vhOJUS (x, y) 
l/M«i6A>ixWVf^Si(x' , y' ) t. 
*<30«/h«^«SSr2«-r-S, JJLbSrXf-yn 9 1 IT 

[0 04 9] <R(C. H 1 2c50^T'vri 3 0 5<7)^^^ 
5-X-^Sfi*Klfc:ov^T»W-ft. B<ft*2ttkLfc 
■tSC( 2«Ua±<0^«(?>«^t 2«&7>&«0* l >ilL 
^T\ *-f e ti2ftT*#i.TJ:o) . -eco-rWi. x, 
y^-^J^Mji. HNS. ^il/te^^T^-k^T 
*S. J: j£ (x, y ) . (x'.y')ii 

KiToi'jca**. 

[00 5 0] 

[mi ] 



(8) 



2 20 6 0 



cose sinf\/x\ /ax 
-sinS cos^/\y/ \Ay 



Xm 



m (cos0 • x+sinS « y-Ay) 
m (-sin^ 'X+cos0 • y-Ay) 



Ax+By+C \ 
-Bx+ Ay+D/ 

[00 5 1] 0»iZ«|[II9<OEHE#. Ax&tX 

i:3&«-c#&. ^w/Sj^ajasjaaTii. *tje* (x. 

e=£ [ { (Ax+Byfc) -x 
2 ] — >m i n 



(D 



y) . (x' , y' ) <o*»Ofi£ffi»Lfc. 

D 



(-BxfAy + D ) -y ' 
(2) 



[00 52] 



[»2] 



a B /<JA= ( 2 x 2 + Z y 2 ) A+ ( 2 x ) C+ ( Z y) D+ ( - Z xx- Z yy' ) =0 
d*/eB= (Zx 2 +Zy 2 ) B+ ( Zy) C- (Zx) D+ (-Zx* y+Zxy ) =0 
6 1 /aC= ( Z x) A+ ( Z y) B+nC- ( Z x') =0 
Oe/OD- (Z y) A- (Zx) B+nD- (Zy ) =0 (3) 



[0 0 53] £ffi£2^7*~-?A. B. C. D 



= Xx 2 -hHy 2 
= £x 

= £ X X ' 



p 3 
p 4 



+ £y y ' 
A = 
B = 
C = 
D = 



(P 2 
(P 3 
(P 6 
(Pv 



P 6 +Ps 
P 6 "P 2 
- P 2 A- 



P7 
P7 
P3 



-Pa A + P 2 



"P 4 Ps 
+ P 5 P 8 
B)/P 8 
B) /P 8 



P 5 =Xxy' -Xx' y 

P 6 = 2x' 

P 7 = Zy' 

P 8 =n (ffl»j£<OR) 

) / <P 2 * + P 3 2 -Pi P 8 
) / (P 2 2 + P 3 2 -Pi P 8 



(4) 



[00 54] Pi /Pfe P 8 ±5* 

(4) WtAlT&^^J: D^^-^A. B. C. D 

x ' =Ax+By+C 
y ' =-Bx + Ay + D 

[0 0 5 6] HI 6fr;:£;ft&l27SLfc&co£Sr$\ 

2 1 0 3^: LT51ffi*r^o <I<I(c. i-T;£B«S:-5-0* 
ah-LT<&<> ^j£««<0»9«tt (x. y) 
fcro^T, ±^*»t*H&f& (x' . y' ) Sr^S. 
*LT=&BfflW> ( x' , y' ) ?)H5I£ <x, y ) ten 

3o 



[0055] mmzmi 2^^^n 30 

(5) 



t„ xf7r2 2o it. skomr (mi exw&m 

MftE (x. y) £o^T. ±^3&»£*tJfrrS (x' , 
y' ) Xf7r2 2 0 4t, (x' , y' ) 

fiy^U ft*ltfXfyr2 2 0 5t <x' , y' ) 



(9) 



^f9-3 2 20 60 



C9HS£ (x, y) C3t-«. £Lt£Xf >yT2 2 
[00 58] 

[ W»z«&» J feLhBMH Lfc J: a tc. 1 vtfffltz 
J:4HKftS!Kfc:J:*Uf. ^yt^-m^gfClD 

& mm*mmt,z&£&m-a=i out *> . 

[O0603 4fc,SU m 2^«l2H«S:Bffl^^ 
* i k fc: J: 0 . ffiffl#tt«Bffi«£ JM:0*£ . #B«H 
^a'-7 7 ri £ 5112 L £ B«taa Sr M«J ^ 
tf>4£ k3&«TS . ifiteJ: 0 . lffl»^B«*«IH±o*36« 

*(Ci&B=5rfflROB«*a»T* S. 
[00 61 ] ^NV^-eB^^^L^^--^' 

Scfco fcrTS £ t (c «t 0 «#KJliE*{S{tCcoB«a«K 

imi ] *^^SS^®^i;^^^^^c7)7'nv 

[132] «^^9<7)«»BS^)7u-^^-hT**>-S). 
[H3 ] ^H^^teo^fe^B^^^Bm^JS^x 

[H4 ] *«^SIIifi^J^tcJ:*B«-&ffico^XxA 
[H6 ] *yXfA^ft(7)Sli«il$:^t7o-f 



[08] Xr^^^»*^i>^B«^*a»ffl«?&ii» 

[09 3 mnimznft^&mm<D7u-^v~-hT%> 
&. 

[010] iIigB«^0S^k iBiEiaB3&»S:f"x y * 
[011] aQEffl«*KW&»«BITftS. 

[012] ^^y^^BaffffiJDao^flcco^Jis^-r^ 

[013] ffl»ffll<!Ol»S»SSt7D-f t - 

[014] »jEjsaaj«ra^7o-^--h'Cft*. 
[015] ttmj!mft!mx*(0Ty7 m i'~hmmk~?v 

[016] £jfc^**Lfcf»fi0T*£. 
[017] MW70-f^»htfc§ . 

206 mmm? 

2 10 DSP 

212 ^7 7r^y 

2 14 .x^yjss 

2 2 0 ^*xAW»E]» 
23 2 ^ffll/F 

3 0 1 =7 >- 1° jl— ^ yXfA*ft 
302 yM-Xri/— ' 

3 03 
305 

3 06 M>fy^-7x-X 

307 m^*^ 

5 04 rr , j^3vy7h , )i7 

5 0 5 jfr^V— <r >r y^yXfA 
2 3 0 1 31 1 B4& 

2302 mi commmm 

2 30 3 »2<?Dill2B« 

2304 sm#?> 

2 30 5 

2 504 #88;^— y 



[01 3] 







(X, Y) = (x*a, y * a 



1002 



(10) 



Hif9-322060 



CHI] 



2 1 2 



2 0 4 




2 2 8 



SCSCI I/F 













2 3 2 



2 3 4 



[H2 3 



CH7] 



3 0 I 



3 0 3 



3 0 4 



— \S 



3 0 5 



2J01 



26 



02 



I 



103 



2604 



■>7 h& <<*x, ^y) £j££<5 



15 



05 



»l©W*ICMr««»«« (x. y) \ 



J506 




[04] 



SOfi . U 

Afc5^ 

^ 



7r~7r 



«■- iK-K 



7" 



v5x 



510 



•7 WA' 



try* 






7i-X 



5,1 X 5ll V 



337 



\ 303 



(12) 



^^9-3 220 60 



[05] 




[06] 




(13) 



#Bff s F9-3 2 20 6 0 



[081 



(x.y) = (xf^x, yf^y) 



<0,0) 
25^ 



<x,y) 



2502 

J 



2507 



m i <om®m& 



2502 



2504 



^ 1 OHKSfll 

^x, ^y) 



2506 
505 



J 



CH9] 



>| 2701 





*T© (-1 x a. -dy o) 



( 14 ) 



#1^9-3 2 20 60 



[01 0] 
m ) 



[01 1] 



2^01 




1 cD5SS2®«i JP 2 01EI3IEH* 



805 



[01 2] 



01 



1306 





^06 














[0143 




(15) 



HW9-322060 
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